Predicting and understanding law-making with word vectors and an ensemble model
نویسنده
چکیده
Out of nearly 70,000 bills introduced in the U.S. Congress from 2001 to 2015, only 2,513 were enacted. We developed a machine learning approach to forecasting the probability that any bill will become law. Starting in 2001 with the 107th Congress, we trained models on data from previous Congresses, predicted all bills in the current Congress, and repeated until the 113th Congress served as the test. For prediction we scored each sentence of a bill with a language model that embeds legislative vocabulary into a high-dimensional, semantic-laden vector space. This language representation enables our investigation into which words increase the probability of enactment for any topic. To test the relative importance of text and context, we compared the text model to a context-only model that uses variables such as whether the bill's sponsor is in the majority party. To test the effect of changes to bills after their introduction on our ability to predict their final outcome, we compared using the bill text and meta-data available at the time of introduction with using the most recent data. At the time of introduction context-only predictions outperform text-only, and with the newest data text-only outperforms context-only. Combining text and context always performs best. We conducted a global sensitivity analysis on the combined model to determine important variables predicting enactment.
منابع مشابه
Ensemble strategies to build neural network to facilitate decision making
There are three major strategies to form neural network ensembles. The simplest one is the Cross Validation strategy in which all members are trained with the same training data. Bagging and boosting strategies pro-duce perturbed sample from training data. This paper provides an ideal model based on two important factors: activation function and number of neurons in the hidden layer and based u...
متن کاملPredicting distribution of Eurasian Lynx (Lynx lynx) using an ensemble modeling approach: A Case Study: Saveh Zarandieh Kharaghan Area, Markazi Province
Adequate knowledge about suitable habitats for wildlife is essential to prevent habitat destruction and extinction of species and for their conservation and management. The Eurasian lynx is one of the mostly distributed cats in Asia. In this study, we applied an ensemble habitat suitability modeling approach, using ten predictor variables to model Eurasian Lynx’s habitat suitability in Saveh Za...
متن کاملMeasuring robust overall profit efficiency with uncertainty in input and output price vectors
The classic overall profit needs precise information of inputs, outputs, inputs and outputs price vectors. In real word, all data are not certain. Therefore, in this case, stochastic and fuzzy methods use for measuring overall profit efficiency. These methods require more information about the data such as probability distribution function or data membership function, which in some cases may no...
متن کاملPredicting Bankruptcy of Companies using Data Mining Models and Comparing the Results with Z Altman Model
One of the issues helping make investment decisions is appropriate tools and models to evaluate financial situation 0f the organization. By means of these tools, investors can analyze financial situation of the organization and identify financial distress or an ideal condition, they become aware of making decisions to invest in appropriate conditions. The main objective of this study is to ev...
متن کاملFuzzy multi-criteria decision making method based on fuzzy structured element with incomplete weight information
The fuzzy structured element (FSE) theory is a very useful toolfor dealing with fuzzy multi-criteria decision making (MCDM)problems by transforming the criterion value vectors of eachalternative into the corresponding criterion function vectors. Inthis paper, some concepts related to function vectors are firstdefined, such as the inner product of two function vectors, thecosine of the included ...
متن کامل